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Abstract —A protograph-based low-density parity-check 
(LDPC) code design technique for bandwidth-efficient coded 
modulation is presented. The approach jointly optimizes the 
LDPC code node degrees and the mapping of the coded bits 
to the bit-interleaved coded modulation (BICM) bit-channels. 
For BICM with uniform input and for BICM with probabilistic 
shaping, binary-input symmetric-output surrogate channels 
are constructed and used for code design. The constructed 
codes perform as good as multi-edge type codes of Zhang and 
Kschischang (2013). For 64-ASK with probabilistic shaping, a 
blocklength 64800 code is constructed that operates within 0.69 
dB of I log 2 (l -I- SNR) at a spectral efficiency of 4.2 bits/channel 
use and a frame error rate of 10“®. 

I. Introduction 

Bit-interleaved coded modulation (BICM) combines high 
order modulation with binary error correcting codes [1]. This 
makes BICM attractive for practical application and BICM 
is widely used in standards, e.g., in DVB-T2/S2/C2. At a 
BICM receiver, bit-metric decoding (BMD) is used [2, Sec. 
II]. Achievable rates for BMD were investigated for uniformly 
distributed inputs in [2] and for non-uniformly distributed 
bits in [3]. These results were generalized to non-uniformly 
distributed input symbols in [4] and [5]. 

When designing low-density parity-check (LDPC) codes 
for BICM, the key challenge is to take into account the 
unequal error protection of the LDPC coded bits and the BICM 
bit-channels that are different for different bit-levels. A hrst 
approach is to take an existing LDPC code and to optimize 
the mapping of the coded bits to the BICM bit-levels. This 
was done, e.g., in [6]-[8]. A more fundamental approach is 
to directly incorporate the different bit-channels in the code 
design. This is done in [9], where the authors use multi¬ 
edge type (MET) codes [10] to parameterize the different bit- 
channels. They then extend the extrinsic information transfer 
charts (EXIT) [11] to multiple dimensions to design codes 
for quadrature amplitude modulation with 16 signal points 
(16-(3AM). As 16-QAM can be constructed as the Cartesian 
product of two four point amplitude-shift keying (4-ASK) 
constellations, two different bit-channels are apparent. Eor 
constellations with more than two different bit-channels, the 
authors of [9] observe long runtimes of their multidimensional 
EXIT approach. Therefore, they suggest a high-order extension 
based on nesting, i.e., starting from m = 2, they successively 
extend their codes from m to m -I- 1 bit-levels by optimizing 
in each step only the additional bit-level. 

In this work, we follow [9] and jointly optimize the code 
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structure and the mapping of the coded bits to the BICM bit- 
levels. However, we propose a protograph-based design [12] 
and use protograph EXIT (PEXIT) analysis [13] to determine 
the ensemble iterative convergence threshold by accounting 
for the different bit-channels associated with the protograph 
variable nodes. The protograph ensemble is optimized with 
respect to the threshold by differential evolution. A design of 
protographs for coded modulation was hrst introduced in [14], 
which relies on a variable degree matched mapping (VDMM). 
More specihcally, in [14] each bit-level is associated to a 
specihc protograph variable node following the waterhlling 
approach (i.e., assigning the most protected coded bits to 
the bit-levels with highest bit-channel capacities). Recently, 
a protograph-based coded modulation scheme was introduced 
in [15] by performing a one-to-one mapping between the 
constellation symbols and the codeword symbols of a non¬ 
binary protograph LDPC code. This requires the constellation 
order to match the held order on which the LDPC code is 
constructed. To the best of our knowledge, none of the above- 
mentioned approaches leads to a joint binary LDPC protograph 
ensemble and bit-mapping optimization. 

Eor the PEXIT analysis, we represent each bit-channel 
by a surrogate. Our surrogates rehect both the BICM bit- 
channels and the input distribution. We optimize codes both for 
uniformly distributed inputs and for the probabilistic shaping 
strategy proposed in [4]. Our optimized codes show a hnite 
length performance that is as good as the one presented by 
Zhang and Kschischang [9]. Moreover, our design approach 
can be applied to very large constellations. Eor 64-ASK with 
probabilistic shaping, our blocklength 64800 code operates 
within 0.69dB of ilog 2 (l -t- SNR) at a spectral efficiency 
of 4.2 bits/channel use and a frame error rate of 10“^. 

This paper is organized as follows. In Sec. II, we review 
bit-metric decoding. We present our code design approach in 
Sec. III. In Sec. IV and Sec. V, we discuss the performance 
of our codes for uniform and shaped inputs, respectively. 

IT Bit-Metric Decoding 

Consider the discrete time additive white Gaussian noise 
(AWGN) channel 

Y = AX + Z (1) 

where the noise term Z is zero mean, unit variance Gaussian, 
and where the input X is distributed on the normalized 2"*- 



ASK constellation 

A’ = {±1,±2,...,±(2™-1)}. 


Figure 3. Above, the tanner graph of basematrix A with e = 2 and / = 3 is 
displayed. Below, an example lifting with Q = 2 instances of the protograph 
is shown. 


The constellation spacing A controls the average power 
E[|AXp], where E[-] denotes expectation. The signal-to-noise 
ratio (SNR) is SNR = E[|AX|^]/1. Each signal point x G X 
is labeled by m bits B = (Bi, 82 ,..., 8 ^,). The 8 ^ represent 
the bit-levels. Throughout this work, we label by the binary 
reflected Gray code (BRGC) [16], e.g., see Fig. 1. Let py|b be 
the memoryless channel with random input B and output Y. 
The bit-metric of bit-level i is the L-value 




, -Pb,|y( 0 | 2 /) 

®^b,|y( 1 | 2 /) 


(3) 


where PsilY can be calculated from the joint distribution 


PB,Y{bi,y)= pY|B(y|a)PB(a)- (4) 

aG{0,l}"^ : ai—bi 


A bit-metric decoder uses the L-values Li, L 2 , ■ ■ ■, Lm to 
estimate the transmitted data. For the decoder, the channel 
appears as m parallel bit-channels, see Fig. 2. Bit-metric 
decoding can achieve the rate [5, Theorem 1] 

m 

i?BMD=H(B)-^H(B,|U) (5) 

z=l 


where IHI(-) denotes entropy. 

Remark 1 . If the bits Bi, 82,..., 8^ are independent, then 
(5) can be written as [ 2 ], [ 3 ] 


-Rbmd = ^ I (Bi; Li) (6) 

i=l 


where 1I(-;’) denotes mutual information. 

Remark 2 . If the bits Bi, 82,..., 8^ are independent and 
uniformly distributed, then the L-values (3) can be written as 


. , Py|b.(2/|0) 

Li = log /MV 

Py|b.(2/|1) 


(7) 


We use L-values as defined in (3) and the achievable rate 
as defined in (5), since we will use non-uniformly distributed 
inputs in Sec. V. 


III. LDPC Code Design 

LDPC code ensembles are usually characterized by the 
degree profiles of the variable and check nodes of the Tan¬ 
ner graph representation of the sparse binary parity-check 
matrix H G ^(n-k)xn Section 3.3]. For instance, 

and p{x) = Yfd=i PdX^~^ are the edge- 
perspective variable and check node degree polynomials with 
maximum degree dy and dc, respectively. However, the degree 
profiles do not characterize the mapping of variable nodes to 
different bit-channels. In the following, we use protographs to 
incorporate the bit-mapping in our threshold analysis. 

A. Protograph-Based LDPC Codes 

Starting from a small bipartite graph represented via its 
basematrix A — [bik] of size ex/, one applies a copy-and- 
permute operation (also known as lifting) to create Q instances 
of the small graph and then permutes the edges so that the local 
edge connectivity remains the same. The Q replicas of variable 
node Vfe, k G {1 ,...,/} must be connected only to replicas of 
the neighbors of 14 while maintaining the original degrees for 
that specific edge. The resulting bipartite graph representing 
the final parity-check matrix H possesses n = Q ■ f variable 
nodes and n—k = Q-e check nodes. Parallel edges are allowed, 
but must be resolved during the copy-and-permute procedure. 
An example protograph with the corresponding basematrix and 
an example lifting for Q = 2 are shown in Figure 3. 

B. Surrogate Channels 

Optimizing LDPC codes directly for the m bit-channels in 
Fig. 2 is difficult, as they are usually not output-symmetric 
and do not possess uniform input in the case of probabilistic 
shaping. We instead optimize for a surrogate channel. The opti¬ 
mized code works well on the original channel if the surrogate 
channel preserves some characteristics of the original channel 
and if the code is universal in the sense that its performance 
depends mainly on these characteristics. We propose to use 
the rate backoff as the key characteristic, i.e., if R* is the 
achievable rate of the original channel and R is the actual 
transmission rate of the code, we assume that the decoding 
error probability depends on the rate backoff 

R*-R. (11) 
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We design codes for a surrogate channel with the same rate 
backoff. Let R be the transmission rate and R* the achievable 
rate of the surrogate channel; we require 

R* - R = R* - R, ( 12 ) 

Suppose our code rate is c so that (1 —c)m bits per channel use 
consist of redundancy bits on average. Thus, the transmission 
rate is 

H(B)-(l-c)m. (13) 

For instance, for uniformly distributed inputs, the transmission 

rate is R = cm. By (5) and (13), the rate backoff is 

m 

(l-c)m-^H(B,|U). (14) 

Note that the term (1 — c)m does not depend on the channel. 
Thus, we operate the surrogate channel at the same rate backoff 
if 

m m 

^H(B,|U) = ^h(b,|Y,) . (15) 

i-l i=l 

Since we want to account for the different bit-channels, we 
restrict our surrogate channel further by requiring equality for 
the individual conditional entropies in (15) for each bit-level. 
We use biAWGN channels with uniform input as surrogate 
channel, i.e., we have 

'^i = Xg.+Zi (16) 

where the B^ are binary and uniformly distributed, xq = 1, 
xi = — 1, and where is zero mean Gaussian with variance 
where 

H(B,|U) =h(b,|Y,) . (17) 


C. PEXIT Analysis 


The analysis of the asymptotic decoding threshold can be 
done by PEXIT analysis [13]. For EXIT chart analysis, the J 
function is widely used. The value J (cch) hereby represents 
the capacity of the biAWGNC with variance cr^, where — 


OO 

J (cTch)= 1 - y 

— OO 
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log2 (1 + e-^) dL 
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( 18 ) 


PEXIT analysis requires tracking the extrinsic mutual infor¬ 
mation values Ie per {Vk,Ci) pair to accommodate for the 
edge connections imposed by the protograph basematrix and 
the (possibly different) reliability of the coded bits 14. The 
PEXIT algorithm is summarized as follows: 

1) Initialize each achkjk G {1,...,/} with a corre¬ 
sponding aBi,i G {1, ■.. ,m} (17) originating from 
the biAWGNC surrogates. For all tuples (Vk,Ct), k G 

G {l,...,e}, set the a priori mutual 
information values Ieci^v^. ~ !*■ 

2) Perform variable to check node update (8) for all 
tuples {Vk,Ci). 

3) Perform check to variable node update (9) for all 
tuples {Vk,Ci). 

4) Calculate Japp, , A: S {1,...,/} (10). 

5) Stop if all Japp, = 1, otherwise go to 2). 

IV. Code Design eor Uniform Inputs 

A. Optimization Procedure for Protograph Ensembles 

We impose restrictions on the dimension of the basematrix 
A G {0,1,...,S'}®^'( The parameters e and / determine how 
many different variable degrees per bit-channel can occur and 
are chosen to represent the desired code rate c = The 
maximum number of parallel edges S is crucial for both the 
performance of the code and the success of the optimization 
procedure. The product e • S describes the maximum variable 
node degree in the final code and thereby determines the 
size of the optimization search space. The optimization of the 
basematrices is performed by differential evolution (DE), see 
[18]. 

B. Numerical Results 

In order to compare our code design approach to the setting 
of Zhang and Kschischang [9], we design codes of rates 1/2 
and 3/4 for 4-ASK constellations with uniform inputs. The 
optimized protographs are depicted in Table 4. We discuss the 
rate 1/2 code in more detail. The coded bits are transmitted 
over two different bit-channels. For each bit-channel, we allow 
3 (possibly different) variable degrees so that always 3 variable 
nodes in the protograph are assigned to the same surrogate 
channel: = 

^chg ~ Once the optimized basematrices have been 

found, we construct quasi-cyclic parity-check matrices with 
blocklengths n = 16200. We simulate the constructed codes 
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Figure 4. Optimized protographs and design parameters. 
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Figure 5. 16-ASK: Performance of a rate 1/2 optimized protograph code Figure 6. 16-ASK: Performance of a rate 3/4 optimized protograph code 

compared to the rate 1/2 MET code in 19]. compared to the rate 3/4 MET code in 19]. 


using 100 decoding iterations. The bit error rates (BER) and 
frame error rates (PER) in Fig. 5 and 6 show that the finite 
length performance of our codes is equal to or slightly better 
than the codes in [9]. The decoding thresholds given in Table 4 
are obtained by PEXIT analysis for the surrogate channels. 

V. Code Design for Shaped Inputs 

We briefly outline how our design procedure can be used 
to design LDPC codes for the probabilistic shaping scheme 
proposed in [4]. 

A. Probabilistic Shaping 

Fig. 7 illustrates the shaping scheme. The key observation 
is that the capacity-achieving distribution of ASK constel¬ 
lations in Gaussian noise is symmetric around the origin. 
Consequently, the capacity-achieving distribution induces a 
distribution T’biB 2 -b„ on the BRGC labeling with the fol¬ 
lowing properties: 

• bit-level Bi is uniformly distributed (bit-level Bi 
decides on the sign of the transmitted constellation 
point, see Fig. 1). 


• bit-levels (B 2 • • • B^) and bit-level Bi are indepen¬ 
dent. bit-levels i? 2 , ■ • •, Bm are correlated. 

This suggests to mimic the capacity-achieving distribution 
in the following way: first, generate bit-levels B 2 • • • B^ ac¬ 
cording to Pb 2 - B„, e.g., by using a distribution matcher 
(see Fig. 7). Then encode by a systematic encoder of rate 
(to — 1)/to that copies the bits B 2 • • • B^ to its output and 
leaves their distribution un-changed. The encoder appends 
check bits Bi that are approximately uniformly distributed be¬ 
cause each check bit is a modulo two sum of many information 
bits [19, Sec. 7.1]. The signal point a:BiB 2 -Bm selected by 
the bit-mapper then has approximately the capacity-achieving 
distribution. 


B. Surrogate Channels 

As discussed before, the channel appears to the receiver 
as a set of to parallel binary input channels, see Fig. 2. The 
non-uniform distribution Pb 2 - b„ influences each channel law 
P\_.\Bi via (4). Consequently, it also influences the conditional 
entropies ]HI(Bi|Li) in our surrogate channels (17) that we use 
for code optimization. 









































































^ Matcher j—> (B2 ■ ■ ■ —>(^LDPC Encoder(B2 ■ ■ ■ Bm)”^B^ Bit-Mapper j—> 


Figure 7. Probabilistic shaping as proposed in [4]. Independent uniformly distributed data bits = U 1 U 2 • ■ ■ Uk are matched to strings (B 2 B 3 • • • Bm)*, 
i = 1, 2 ,.. ., rt that are distributed according to ■Pb 2 ■ B™ . The systematic LDPC encoder appends rtc check bits = B11B12 ■ ■ ■ Bitjj.. The bit mapper maps 
this bit stream to signal points according to the BRGC labeling. The overall rate is k^/nc [bits/channel use] and the rate of the LDPC code is (m — l)r^;/(mrt) = 
(m — l)/m. At the receiver, a bit-metric decoder calculates an estimate of (B 2 ■ • • Bm)^ B^. A data estimate 0^ = U 1 U 2 ■ ■ ■ is obtained by passing 
the estimate of (B 2 ■ ■ ■ Bm)^ through a dematcher. For the matcher and the dematcher, we use the implementation http://www.lnt.ei.tum.de/fileadmin/stafty 
gu92vox/matcher.zip. 



1 


n 


1 

1 




+ 

X 

O 

i log2(l + SNR) 


64-ASK sha 

■ 64-ASK unil 

64-ASK unil 
Optimized P 

Ded, BMD 

orm 

orm, BMD 
•Qtograph 












r-'- 







).69dB 



0.66dEi..-- 



' * 




X 

) 

X 

X 

( 

X 

( 

X 

> 

X 

:_ 1 

X 

t 

_ 1 

X 

( 

) 

X 



_ 1 

_ 1 




4.6 


4.4 


4.2 - 


4 - 


3.8 


25 25.2 25.4 25.6 25.8 26 26.2 26.4 26.6 26.8 27 

SNR [dB] 


Figure 8 . 64-ASK: The operating point of an optimized protograph code of 
blocklength n = 64800 and FER= 10“®. For comparison, AWGN capacity 
and power-rate curves are displayed. 


C. Numerical Results 

We optimize codes for 64-ASK with probabilistic shap¬ 
ing. To obtain a close-to-optimal input distribution, we use 
the approach of [20], [5, Sec. 3] with a sampled Gaussian 
(Maxwell-Boltzmann) distribution. We maximize the resulting 
BMD rate (5) over the constellation spacing A in (1). The 
results are shown in Fig. 8. Our optimized protograph code 
of blocklength n = 64800 shows a gap of 0.69 dB to AWGN 
capacity at 4.2 bits/channel use for FER= 10“^. Our operating 
point is 0.66 dB more energy efficient than ideal uniform 64- 
ASK and 1.17dB more energy efficient than ideal uniform 
64-ASK with bit-metric decoding. 

VI. Conclusion 

We proposed a protograph-based LDPC code design ap¬ 
proach for bandwidth-efficient coded modulation that is suit¬ 
able both for uniform and shaped inputs. The different bit- 
channels are replaced by biAWGN surrogates so that PEXIT 
and differential evolution give ensembles with good decoding 
thresholds. The performance of the new codes for uniform 
inputs are as good as the best codes in literature. Eor shaped 
inputs, the new codes operate close to ^ log 2 (l-l-SNR). Euture 
research should investigate the influence of the surrogates on 
the code performance by employing a full-fledged density 
evolution for protographs. Eurthermore, precoded protographs 
should be considered to improve the threshold without increas¬ 
ing the variable node degrees. 
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